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What is a systems approach? The first step towards answering this question is 
an understanding of the history of the systems movement, which includes a survey 
of contemporary systems discourse. In particular, I examine how systems researchers 
differentiated their contribution from mechanistic science - but also from holistic doc- 
trines; and identify the similarities and sharpest differences between complex systems 
and other systems approaches. Having set the scene, the second step involves develop- 
ing a definition of 'system' consistent with the spirit of the systems approach. 



1.1 Introduction 

If someone were to analyse current notions and fashionable catch- 
words, they would find 'systems' high on the list. The concept has 
pervaded all fields of science and penetrated into popular thinking, 
jargon and mass media. 

Ludwig von BertalanfFy, 1968 

Since von Bertalanffy's jlOlj theory of open systems introduced the idea of a 
General Systems Theory (GST) which rose to prominence in the mid twentieth 
century, the field of systems research has become ever more fashionable, and the 
closely knit couple of GST and cybernetics have given birth to a large family of 
systems approaches, including complex systems [451 1621 [TT| . nonlinear dynami- 
cal systems HH] , synergetics [SD] , systems engineering [5T] , systems analysis [37] , 
systems dynamics [33], soft systems methodology f3P, second order cybernet- 
ics [1051 [77] , purposeful systems [1] , critical systems thinking [99] 156] [57] , total 
systems intervention [32], and systemic therapy [T7]. As well as adding systems 
concepts to the tool sets of all fields of science, the systems approach has opened 
up new areas within disciplines, such as systems biology [66j, and created new 
hybrid disciplines at the interface between traditional disciplines, such as socio- 
biology [115] , Many of these systems approaches are introduced in Midgley's 
[79| epic four volume collection on systems thinking. Diversity is clearly a major 
strength of the systems approach, but this also makes it difficult to characterise. 
Consider the following typical definition of a system: 



Definition 1.1 (System (5)) A system is a set of entities with relations be- 
tween them f69j . 
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By this definition, the converse of a system is a set of entities with no relations, 
not even logical ones, between them: a heapQ. But heaps cannot exist physically, 
they are only an idealisation, since logical relations can always be established 
between a set of entities. Alternatively, it could be argued that an indivisible 
'atomic' element does not meet the definition (provided trivial sets and relations 
are excluded). Thus a system is never undifferentiated. Nevertheless, under 
this definition, just about everything bigger than an electron is a system, which 
makes 'system' a vacuous container concept until it is further qualified. For 
example, the following systems engineering definition only considers physical 
systems in functional relationships: 

Definition 1.2 (System (6)) A system is a bounded region in space-time, in 
which the component parts are associated in functional relationships JJ8y . 

While there have been many attempts consistent with this definition to make 
systems the Furniture of the Worlco [111 vol. Ill], claims that the world is 
systemic - usually synonymous with naive realist and 'hard' systems research - 
are problematic. They ignore the fact that systems thinking involves its own set 
of simplifying assumptions, modelling choices and reductions. They also ignore 
the insights of second order cybernetics |105j , that the observer (and by extension 
the systems theorist) should also be considered as a system. However, there is no 
need for systems approaches to make the bold claim that the world is "made up 
of" systems. Knowledge that is obtained using a systems approach makes more 
sense when it is seen as one perspective for thinking about the world, rather 
than an objective property of bounded regions of space-time. Consequently, a 
definition of system should define how the real world is idealised, represented 
and acted upon when viewed as a system. A definition of system will not tell us 
how to discern when a part of the world "is a system" , but it can shed light on 
when it may be appropriate to utilise a systems approach. 

It is also important to stress that the opposite extreme of a relativist and 
purely subjective account of systems, where all views are equally valid, is not 
appropriate. In this paper, I will take a moderate approach that considers the 
insights from both hard and soft systems approaches. The utility of a systems 
perspective is the ability to conduct analysis without reducing the study of a sys- 
tem to the study of its parts in isolation. Knowledge obtained from the systems 
perspective can be as "objective" as knowledge obtained from a reductionist sci- 
entific perspective. In this way, a systems approach contributes valuable insight 
capable of complementing the traditional analytic method. 

This paper begins by describing the scientific climate prior to the systems 
movement. Next, the history of systems thinking is interpreted. There are 
many different stories that could be told to make sense of the development of 
the systems approacl|f|. This particular history is selectively biased towards the 

^Aristotle [7] used the concept of a heap to refer to matter without form. 
^That is, give systems an ontological status or "real" existence. 

^Alternatives include Checkland 31 and Matthews |76| . or see Lilienfeld 1731 for a partic- 
ularly spiteful critique. 
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design of complex systems. It emphasises the key concepts that differentiate 
between members of the systems family. The systems approaches I survey are 
general systems theory, cybernetics, systems analysis, systems engineering, soft 
systems and complex systems. Finally, I develop a definition of 'system' as a 
concise summary of the systems approach. 

1.2 Science Before Systems 

If the Renaissance was a period of re-discovery of classical Greek science, then 
the subsequent period of the Enlightenmeni|f| produced the scientific revolution 
that provided a foundation for the Modern worldview [76]. Descartes, the 'father 
of modern philosophy', played a pivotal role in the self-understanding of Enlight- 
enment science. In an attempt to demarcate between knowledge derived from 
science/philosophy and superstition, Descartes described a scientific method, the 
adherence to which he hoped could provide privileged access to truth. Descartes' 
[36j method contained four precepts: 

The first was never to accept anything for true which I did not clearly 
know to be such; that is to say, carefully to avoid precipitancy and 
prejudice, and to comprise nothing more in my judgement than what 
was presented to my mind so clearly and distinctly as to exclude all 
ground of doubt. 

The second, to divide each of the difficulties under examination into 
as many parts as possible, and as might be necessary for its adequate 
solution. 

The third, to conduct my thoughts in such order that, by commenc- 
ing with objects the simplest and easiest to know, I might ascend 
by little and little, and, as it were, step by step, to the knowledge 
of the more complex; assigning in thought a certain order even to 
those objects which in their own nature do not stand in a relation of 
antecedence and sequence. 

And the last, in every case to make enumerations so complete, and 
reviews so general, that I might be assured that nothing was omitted. 

The first rule of sceptical inquiry, and the fourth rule of broad and complete anal- 
ysis, describe the dominant approach to Modern Western philosophjd. Mean- 
while, the second rule of analytic reduction, and the third rule of understand- 
ing the simplest objects and phenomena first, became influential principles of 

*The Enlightenment usually refers to the period between the signing of the peace accord at 
Westphalia in 1648, which brought stability to Western Europe, and the publication of Kant's 
I6UI Critique of Pure Reason in 1781, which mounted a sceptical challenge to the Enlightenment 
philosophy. 

^The first rule is hardly a contentious principle in philosophy, but the fourth rule is equally 
important. For instance, Broad |23l p. 12] claims that "the greatest mistake in philosophy is 
that of over-simplifying the facts to be explained." 
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Modern science, which would eventually differentiate itself from philosophy. To- 
gether, these two principles provided the view of scientific explanation as de- 
composing the problem into simple parts to be considered individually, which 
could then be re-assembled to yield an understanding of the integrated whole. 
It is this that I will refer to as the Cartesian analytic method. 

While Descartes had articulated a philosophy for the scientific method, New- 
ton's [86] breakthroughs in gravitation and the laws of motion showed the im- 
mense power of simple, precise mathematical idealisations to unify and at the 
same time quantitatively predict the behaviour of diverse phenomena. Newton's 
Law of Universal Gravitation 

^^g™ ^^^^^ 

gives the force of attraction F between two objects idealised as point masses mi 
and 7712, where r is the distance between them and G is a universal constant. 
The law describes the mechanics of gravity by a universal fixed rule, which cap- 
tures the first-order effects that dominate the dynamics of most macroscopic 
inanimate bodies. In particular, our solar system is dominated in terms of mass 
by the Sun, and the inverse square relationship of gravitational force to dis- 
tance means that other solar systems exert insignificant forces on our own. This 
allowed Newton to ignore the great majority of objects in his calculations of 
planetary motion - of the 10^ objects in our solar system, Newton only had to 
consider 10 [113[ p. 13]. Further, by Equation (|l.ip . the force between 77*1 and 
7772 is independent of any other mass rrii. This allows each pair of interactions to 
be considered independently and then summed: superpositionality holds for the 
Law of Universal Gravitation, allowing tremendous simplification. Not only did 
Newton's mechanics provide an alternative cosmology that ended the dominance 
of Aristotle's worldview, it unified terrestrial and celestial dynamics. Once the 
heavens and Earth were seen to be governed by the same laws, it became con- 
ceivable that the mathematics that accounted for the motion of planets could 
also account for life on Earth. 

Newton's mechanics played a primary role in the 19'^ century physics world- 
view of a deterministic, mechanistic Universe, which von Bertalanffy [102] char- 
acterised as the view that "the aimless play of the atoms, governed by the 
inexorable laws of mechanical causality, produced all phenomena in the world, 
inanimate, living, and mental." Polanyi [89|, pp. 6-9] traces the origins of mech- 
anism to Galileo's synthesis of a Pythagorean belief that the book of nature is 
written in geometrical characters, and Democritus' principle: "By convention 
coloured, by convention sweet, by convention bitter; in reality only atoms and 
the void." Even though Newton did not personally emphasise this in his philoso- 
phy, and many classical mechanists were troubled by the implications of action at 
a distance, Newton's followers unequivocally interpreted Universal Gravitation 
as the mechanistic ideal. Laplace, who made important extensions to Newton's 
physics, provided one of the more famous articulations of mechanism. It became 
known as Laplace's demon, after the following passage of Essai philosophique 
sur les probabilites [71] . 



What is a Systems Approach? 



5 



We may regard the present state of the universe as the effect of its 
past and the cause of its future. An intellect which at a certain 
moment would know all forces that set nature in motion, and all 
positions of all items of which nature is composed, if this intellect 
were also vast enough to submit these data to analysis, it would 
embrace in a single formula the movements of the greatest bodies 
of the universe and those of the tiniest atom; for such an intellect 
nothing would be uncertain and the future just like the past would 
be present before its eyes. 

For all of its achievements, the Cartesian analytic method in conjunction with 
mechanism cast a shadow over subsequent Modern science, by setting the laws of 
theoretical physics as an ideal to which the less exact sciences should aspire, and 
to which they might eventually be reduced. In this view, only the mechanical 
properties of things were primary, and the properties studied in other sciences 
were derivative or secondary [55] . 

However, there were many areas of science that resisted the mechanical world- 
view. The debate between the mechanists and the vitalists on the distinction be- 
tween inanimate matter and life dominated biology for three centuries. Roughly, 
the mechanists claimed that life was nothing-but chemistry and physics. Mean- 
while, the vitalists countered that life was irreducible to the laws of physics, 
and the additional vital aspect of living organisms was capable of violating 
the laws of physics, or at least under-constrained by physics: life was in part 
self-determining. This was resolved only in the 1920s when the emergentists 
[21 [3l [231 nil [Ml [84] advanced a middle path that acknowledged the need for 
adherence to the laws of physics, while at the same time denying that all phe- 
nomena could be eliminatively reduced to physics. In retrospect, emergentism 
marked a pivotal advance towards systems thinking. 

Checkland [31] identified three further classes of problems that persistently 
failed to be conquered by the Cartesian analytic method of science. They are 
problems of complexity, problems of social science, and problems of management. 
According to Checkland, the complexity that arises when densely interacting 
variables give rise to 'emergent phenomena' poses a serious problem, one that 
to date reductionist thinking and the experimental method has not been able to 
overcome. 

Secondly, the problems of social science are not just densely interacting, but 
they contain individual human beings with potentially unique private knowledge 
and interpretations that condition their response, limiting the precision and 
general applicability of 'laws' governing social behaviour. In addition, social 
phenomena can always be interpreted from many more possible perspectives 
than are required for natural science. 

Thirdly, Checkland cites management - the process of taking decisions in 
social systems - as problematic for analytic science. Operations Research (OR), 
the scientific approach to management, arose in support of military operational 
decisions during the second world war, and was institutionalised and applied 
widely in industry after the war. However, Checkland claims that OR's ability 
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to solve problems with particular general forms has been of little use to real 
life problems, where the details that make a problem unique predominates any 
insight that knowledge of the general form provides. Even though Checkland 
does not substantiate this assertion, it is reinforced by observations from within 
the OR community that OR is being increasingly relegated to the tactical rather 
than strategic decision-making arena [10] : 

the uniqueness of the OR approach is not seen as indispensable, its 
methodology is challenged, it is regarded as a narrow specialist dis- 
cipline, a suitable sanctuary for mathematicians, its involvement in 
implementation is tenuous and its general impact somewhat limited. 

Whilst it would be a gross oversimplification to say that science prior to 
the mid twentieth century was non-systemic, it was not until this period that a 
self-consciousness of what it meant to be systemic arose. It is in the context of 
a dominant analytic approach to science, and a growing awareness of its limi- 
tations, that the systems movement sought to provide an alternative approach. 
The common usage of 'system' within analytic science prior to the systems move- 
ment meant simply the object or objects of interest. However, this usage does not 
attribute any properties to a system - it acts as a container, merely a convenient 
label for the collection of interacting objects under investigation. In contrast, 
the systems movement began by articulating a more substantial conception of 
system. 

1.3 Enter the System 

In the West, von Bertalanffy's [101] seminal paper on open systems, published 
in 1950, is usually attributed as seeding the rise of the systems movement, al- 
though he had published on a systems approach to biology since 1928 |100) . 
The purpose of the paper was to rigorously account for the key distinction be- 
tween the organismic systems of biology, compared with the closed systems of 
conventional physics. In making this distinction, von Bertalanffy wished to sci- 
entifically account for apparent paradoxes in the characteristics of living systems, 
when considered in relation to the physics of closed systems. For example, the 
second law of thermodynamics states the inevitability of increasing entropy and 
the loss of order, and yet the evolution and development of biological systems can 
exhibit sustained increases in order. By providing empirically supported scien- 
tific explanations of phenomena such as equifinality (when a system's dynamics 
are not state-determined) and anamorphosis (the tendency towards increasing 
complication), von Bertalanffy simultaneously extinguished vitalism and firmly 
established the roots of systems theory in the natural sciences. 

Von Bertalanffy's emphasis on flows of matter (and later energy and infor- 
mation) into and out of an open system brought attention to the environment 
of the open system. This adds something that Definition 11.11 does not contain: 
a system is more than just a set of components and their relationships - it is a 
complex whole that affects and is affected by its environment. Further, a system 
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has a boundary that prevents it from becoming mixed with its environment. 
The impUcation of the environment is that a system must always be understood 
in context. 

The domain of systems theory does not cover all systems - it was never 
intended as a theory of everything. In 1948, Weaver [112j noted that between 
mechanics and statistical mechanics, there was an absence of mathematical tech- 
niques for the treatment of systems with medium numbers of components, whose 
behaviour could be much more varied than either simple machines or very large 
ensembles. Weaver gave a name to the systems in this gap, saying that "one 
can refer to this group of problems as those of organized complexity" . Weaver 
illustrated the domain of organised complexity graphically. A slightly elabo- 
rated version of this graphic by Weinberg [113] is reproduced in Figure 11.11 In 




Complexity 



Figure 1.1: Types of systems, after Weinberg |113j . 

Weaver's view, the entities that systems theory studies are substantial (physical) 
systems. Occasionally, confusion has arisen as to whether the domain of systems 
theory extends to the study of abstract (conceptual) systems. (Ashby [S] p. 260] 
notes this general uncertainty within GST.) This confusion is exacerbated be- 
cause systems theories of both persuasions have been developed, often without 
explicitly addressing their domain of applicability. However, it is fair to say that 
both substantial and abstract systems have been legitimate subjects of systems 
enquiry. 

Checkland [HI pp. 74-92] suggested that systems thinking was founded on 
two pairs of ideas: 

1. Emergence and hierarchy, originating in organismic biology and generalised 
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in GST; and 

2. Communication and control, originating in communication engineering and 
generahsed in cybernetics. 

To these pairs of ideas should be added the requirement for a systems approach 
to be broader than any conventional discipline: a systems approach is funda- 
mentally interdisciplinary. In retrospect, a sophisticated theory of systems that 
preceded both GST and cybernetics had been developed by Bogdanov [35] in 
Russia and published sometime between 1910-1913, but for political reasons his 
Tektology was not widely known until after the Cold War, by which time the 
systems movement was already well established in the West, and synonymous 
with GST and cybernetics. 

Another precursor to a recognised systems movement (by about a decade) 
was Angyal's [6] theory of systems, developed in the context of psychology. In 
particular, Angyal distinguished between relations and systems: 

A relation requires two and only two members (relata) between which 
the relation is established. A complex relation can always be anal- 
ysed into pairs of relata, while the system cannot be thus analysed. 

This distinction leads to the difference between aggregates, in which the parts 
are added, and systems, in which the parts are arranged. Note that Newtonian 
mechanics only describes the behaviour of aggregates. Angyal also realised the 
importance of the manifold that the system is embedded in, saying that a system 
is "a distribution of the members in a dimensional domain." Hence, a system 
is more than a set of interrelated components: the relations must be organised. 
Spatial arrangements are an important determinant of systemic properties. This 
also implies that many combinations of relations will not be possible for any 
particular system, since the relations must conform to the system's organisation. 
Thus organisation imposes order on a system, which can be thought of as a 
constraint on its dynamics. 

Because the systems approach stood in contrast to mechanism (and also the 
related 'isms' of atomism and individualism), some began to associate systems 
with holism. The systems philosopher Bunge [57] recognised this conflation 
and sought to distinguish systemism from holism. According to Bunge [26], 

a holistic philosophy is one that not only accepts the thesis that a 
whole is more than a mere aggregation of its parts: holism main- 
tains also that wholes must be taken at face value, understood by 
themselves, not through analysis. 

Because the holistic approach rejects the possibility of analysis, it relies upon the 
method of intuition, not rational explanation or empirical experiment. While 
the systems approach recognises the existence of emergent properties, it never- 
theless seeks to explain them in terms of how their constituent parts are organ- 
ised. Where holism is satisfied with a non-rational apprehension of un-analysed 
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wholes, systemism aims to demystify emergent properties by providing scien- 
tific understanding that utihses analysis as well as synthesis. Therefore, it is 
equally important that the systems approach be distinguished from holism as 
from mechanism. 

Another important refinement to the philosophical characterisation of the 
systems approach was provided by Churchman [32j , in the form of the following 
question: 

How can we design improvement in large systems without under- 
standing the whole system, and if the answer is that we cannot, how 
is it possible to understand the whole system? 

Ulrich fM', a student and self-proclaimed disciple of Churchman, realised that 
Churchman's question captured "the real challenge posed by the systems idea: 
its message is not that in order to be rational we need to be omniscient but, 
rather, that we must learn to deal critically with the fact that we never are." 
Thus, in a very deep sense, the systems approach is tied to understanding the 
limits of representations. 

1.3.1 General systems theory 

Von Bertalanffy together with Rapoport and Boulding formed the Society for 
General System Theory in 1954, which organised the systems community and 
provided a yearbook from 1956 dedicated to systems research. Along with the 
closely related field of cybernetics, GST helped to define the core principles of 
the systems approach. 

For von Bertalanffy, the main propositions of GST (adapted from \102\ ) were: 

1. Isomorphisms between the mathematical structures in different scientific 
disciplines could integrate and unify the sciences; 

2. Open systems require consideration of the flow of energy, matter and in- 
formation between the system and its environment; 

3. Within open systems, the same final system state may be reached from 
different initial conditions and by different paths - open systems exhibit 
equifinality; 

4. Teleological behaviour directed towards a final state or goal is a legitimate 
phenomenon for systemic scientific inquiry; 

5. A scientific theory of organisation is required, to account for wholeness, 
growth, differentiation, hierarchical order, dominance, control and compe- 
tition; and 



6. 



GST could provide a basis for the education of scientific gcncralists. 
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Von BertalanfFy's principle concern was to provide an alternative foundation for 
unifying science, which he proposed in reaction to the reductionist mechanistic 
worldview. In particular, he rejected the crude additive machine theories of 
organic behaviour, which treated wholes as nothing more than linear aggregates 
of their components. It is notable that von Bertalanffy [1021 1103j really only 
mentions emergence and hierarchy in passing. GST adopted almost unchanged 
the theory of biological emergentism developed in the 1920s, while the task of 
developing hierarchy within GST was taken up by other authors. In fact, I would 
suggest that rather than a theory of general systems, GST resulted in the more 
modest contribution of several theories of hierarchies. The remainder of this 
section on GST will consider the twin concepts of emergence and hierarchy. 

Emergence as "the whole is more than the sum of the parts" justified the 
need to understand systems in addition to understanding their parts. By under- 
standing emergent properties, the general systems theorists felt that they could 
offer insights that the reductionist / mechanist agenda ignored, because mecha- 
nism could not account for the non-additive relationships between components. 
The ability to explain emergent properties is a prerequisite for a general theory 
of organisation. 

The hierarchical nature of systems is a logical consequence of the way system 
is defined in terms of its constituent parts, since the parts may also meet the 
definition of system. This was noted by many authors, but Boulding and Simon 
made particularly influential extensions to this corollary. Boulding's ^21j Skele- 
ton of Science presented a hierarchical view of systems, "roughly corresponding 
to the complexity of the 'individuals' of the various empirical fields." Where von 
Bertalanffy |101| had focussed on the relationship of physics and chemistry with 
biology, Boulding generalised this into a hierarchy with nine levels, which began 
with physics and extended through biology, psychology, sociology and meta- 
physics. Following Matthews [76l p. 201], Boulding's hierarchy is summarised 
in tabular form in Table fTTTl 

Boulding saw these levels as different layers of theoretical discourse. That is, 
the layers were not part of nature itself, but were a way of organising the theo- 
retical concepts and empirical data collected in the various sciences (although it 
has not always been presented this way by other authors). When Boulding later 
aligned specific disciplines with the levels, the intent was to highlight that, for 
example, any analysis of level 8 sociocultural systems using only the methods of 
level 1 and 2 structures and mechanics would be necessarily incomplete. Bould- 
ing's hierarchy has been extended by Checkland [31] and critiqued by numerous 
authors including Capra [29]. Despite its shortcomings, Boulding's hierarchy 
was an influential representation of the relations between the sciences. It also 
reveals a view that many early systems theorists shared: that their role was to 
be one step removed from empirical science, in order to recognise the broader 
patterns occurring across science. Others, such as Bunge [H] and Rapoport [50] . 
later developed more explicit arguments that the systems approach lies midway 
between the scientific and philosophical approaches. 
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Table 1.1: Boulding's hierarchy of systems complexity. 



Level 


Characteristics 


Examples 


Relevant 
Discipline 


1. Structure 


Static 


Crystals 


Any 


2. 

Clock-works 


Pre-determined 
motion 


Machines, the 
solar system 


Physics, 
Chemistry 


3. Control 
mechanisms 


Closed-loop control 


Thermostats, 
mechanisms in 
organisms 


Cybernetics, 
Control Theory 


4. Open 

systems 


Structurally self 
maintaining 


Flames, 
biological cells 


Information 
Theory, Biology 
(metabolism) 


5. Lower 
organisms 


Organised whole 
with functional 
parts, growth, 
reproduction 


Plants 


Botany 


6. Animals 


A brain to guide 
total behaviour, 
ability to learn 


Birds and Beasts 


Zoology 


7. Humans 


Self-consciousness, 
knowledge symbolic 
language 


Humans 


Psychology, 
Human Biology 


8. 

Socio-cultural 
systems 


Roles, 

communication , 
transmission of 
values 


Families, clubs, 

organisations, 

nations 


Sociology, 
Anthropology 


9. Transcen- 
dental 
systems 


Inescapable 
unknowables 


God 


Metaphysics, 
Theology 



Simon's [HS] classic paper on The Architecture of Complexity sought to ex- 
plain some features of naturally arising hierarchies, in contrast to Boulding's 
attempt to relate the description of nature within different disciplines of science. 
Simon proposed that systems with a large number of non-simply interacting 
parts frequently take the form of hierarchy, defined as 

a system that is composed of interrelated sub-systems, each of the 
latter being, in turn, hierarchic in structure until we reach some 
lowest level of elementary subsystem. 

Simon is describing a nested hierarchy, which was later generalised in the highly 
abstract GST dialect of hierarchy theory [T that this paper helped to initiate. 
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There are two central insights in [5S]. Firstly, what Simon saw as the ubiquity 
of hierarchies in natural complex systems is explained by a simple probability 
argument: the time it takes for the evolution of a complex form depends critically 
on the number of potential intermediate stable forms, as these building blocks 
to a large degree insulate the process of system assembly against the effects of 
environmental interference. Given that a hierarchy of building blocks can be 
assembled orders of magnitude faster than a non-hierarchical assembly process, 
among complex forms, hierarchies are the ones that have the time to evolve. 

Secondly, Simon realised that the interactions at each level of the hierarchy 
are often of different orders of magnitude, and commonly the interactions are 
strongest and most frequent at the lowest level in the hierarchy. When these con- 
ditions hold, the hierarchy is nearly decomposable, which simplifies the analysis 
of a complex system in several ways. Near decomposability implies that sub- 
parts belonging to different parts only interact in aggregate, meaning individual 
interactions can be ignored: the levels are screened off from each other by rate 
differences. This is why in modern hierarchy theory, three levels of a hierarchy, 
one up and one down, are generally considered sufficient for analysis of the focal 
level. Also, nearly decomposable hierarchies are highly compressible: they have 
significant redundancy, meaning that a relatively small amount of information 
may adequately describe an apparently complex system. 

1.3.2 Cybernetics 

At about the same time that GST was attempting a general mathematics of 
organisation, the new field of cybernetics was embarking on a similar quest to 
uncover the general mathematics of machines. According to Wiener |114j . who 
suggested the name for the field, 

cybernetics attempts to find the common elements in the function- 
ing of automatic machines and of the human nervous system, and 
to develop a theory which will cover the entire field of control and 
communication in machines and in living organisms. 

In |114j . Wiener described the initial results from the cybernetic community, 
whose impressive interdisciplinary role-call included Rosenblueth, von Neumann, 
McCuUoch, Pitts, Lorente de No, Lewin, Bateson, Mead and Morgenstern. With 
the exception of Morgenstern, they were all members of the core group of ten 
conferences on cybernetics held between 1946 and 1953, sponsored by the Josiah 
Macy, Jr. Foundation and chaired by McCuUoch. Wiener identified the princi- 
ple of feedback as a central step towards the study of the nervous system as an 
integrated whole, outlining the role of negative feedback in control, and positive 
feedback in producing instability. The principle of feedback distinguishes cyber- 
netic systems by their circular organisation, where activity flows from effectors 
acting on the environment, to sensors detecting their outcome, which then act 
upon the effectors, thereby closing the feedback loop. The other major dis- 
tinction that Wiener drew was between communication engineering and power 
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engineering as a basis for understanding mechanical systems. He identified a 
change in emphasis in the former from the economy of energy to the accurate 
reproduction of a signal. The implications of this distinction are that under- 
standing the behaviour of a control system depends not on the flow of energy 
so much as the flow of information. Fortuitously, at the same time Shannon 
|94j was developing a quantitative definition of information as the average re- 
duction in uncertainty, which became one of the dominant frameworks within 
cybernetics, and more generally within systems theory. 

Although Wiener's |114j analogies between calculating devices and the hu- 
man brain now appear dated, a number of the big systems ideas arose from 
Wiener's cybernetic collaborators in attempting to understand the behaviour 
of "all possible machines". They include von Neumann's self-reproducing au- 
tomata |107j . McCulloch and Pitts' [78] model of the neuron that forms the 
basis for artificial neural networks, Maturana's [77] autopoesis, von Foerster's 
|105j second order cybernetics and Bateson's [16| ecology of mind, each exploring 
different implications of circularity. 

Outside the US, the British psychiatrist Ashby had published on what be- 
came known as cybernetics from 1940, inventing the homeostat - a machine 
that adapted towards self-regulation - and writing the 1956 classic text An In- 
troduction to Cybernetics. Ashby's ideas have had a profound influence on com- 
plex systems theory, pre-empting and shaping the complex systems approach, 
and still providing insights on contemporary concerns such as self-organisation, 
adaptation and control. Perhaps Ashby's greatest contributions were the con- 
nections he developed between information theory and systems theory. In [U p. 
3], Ashby observed 



cybernetics typically treats any given, particular, machine by asking 
not "what individual act will it produce here and now?" but "what 
are all the possible behaviours that it can produce?" 

It is in this way that information theory comes to play an essential 
part in the subject; for information theory is characterised essentially 
by its dealing always with a set of possibilities . . . 

Ashby's most famous result, introduced in this book, applies information 
theory to machine regulation to yield the Islv^ of requisite variety. The law pro- 
vides a quantitative measure of the amount of variety a regulator R must absorb 
in order to produce goal-directed behaviour. Ashby realised that the purpose of 
a system could be re-cast as requiring essential system variables, E, to be main- 
tained within certain limits. He argued that natural selection has eliminated 
those organisms that are not able to regulate the flow of environmental variabil- 
ity. The remaining species of organisms all employ mechanisms that actively 
resist environmental disturbances, D, that would push the essential variables 
outside their limits and result in death. 



The law of requisite variety is actually a mathematical theorem, not a physical law. 
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The law is simple to introduce. If different disturbances can be countered by 
the same response by the regulator, they are not countecj^ as distinct members of 
D. If the set of possible outcomes, O, of the disturbance followed by regulation 
(denoted by the transformation matrix T) is within the acceptable limits of E, 
it is compatible with the organism's continued existence (denoted by the set rj). 
In this case, the regulator is considered successful. Let the variety, measured 
as a logarithm of the number of possibilities, of Z?, R and O, be Vd, Vr and Vq 
respectively. Then the law of requisite variety is simply 

Vo<Vd'- Vr. (1.2) 

Intuitively, goal-directed behaviour demands that variety in the outcome remain 
below some bound. In order to reduce Vq, Vr must be increased: only variety 
in the regulator can destroy variety created by the environmental disturbance. 
Anothei[3 way to understand the law of requisite variety is to ask what if i? > Dl. 
Then by Equation 1 1.2[ Vb < =J> O < 1. This means that the disturbances are 
perfectly countered by the regulator, and so there is no variety in the outcome 
of the process. 

The law of requisite variety sheds light on the nature of control. Figure II. 2[ 
adapted from [8], shows the causal influences between the variables introduced 
above and a new control variable C. In this model, C decides the desired outcome 
or sequence of outcomes, which R must obey. Roughly, C, R and E constitute 
the organism or the 'system', which is open to energy and information but closed 
with respect to control. R takes information from the independent sources, C 
and D, and attempts to produce an action that achieves C's objective in spite of 
the external disruption D. The 'environment' T transforms the actions of D and 
R, which influences the value of the essential variables E. Therefore, control over 
E necessarily requires regulation. This can be interpreted as the communication 
of a message from C to E via the compound channel T, while transmitting 
nothing from D. This is not just a superficial analogy to information theory: 
the law of requisite variety is a restatement of Shannon's [94] tenth theorem 
on channel coding. This reveals the deep connections between goal-directed 
behaviour, control, regulation and communication. 

Another connection between information theory and systems is evident in 
Ashby's definition of complexity as the quantity of (Shannon) information re- 
quired to describe a system [10], although Ashby was not the first to propose 
this definition. 

Where GST predominantly analysed structure to understand organisation, 
cybernetics developed a complementary approach for analysing dynamical be- 
haviour, independently of how the system was internally structured. The two are 
complementary because structure can be viewed as a constraint on the system's 
dynamics, while the dynamics are responsible for the formation of structure. The 

'^This way of counting disturbances does a lot of the work in the law of requisite variety, 
and it is the key assumption that must be satisfied for real world applications of Ashby's law 
to be valid. 

^Thanks to Scott Page for this suggestion. 
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Figure 1.2: Control and regulation in Ashby's law of requisite variety. 



behaviourist approach to modeUing systems was formaUsed within cybernetics 
by generahsing the electrical engineer's 'black box'. The black box approach 
assumes that the internal structure of a system is hidden, and so knowledge of 
the system must be obtained by systematically varying inputs to the system and 
observing the corresponding outputs. The same approach to behavioural psy- 
chology is described as stimulus-response (as in |110j ). and both terminologies 
were used interchangeably in cybernetics. 

Although GST and cybernetics were strong allies in advancing the systems 
movement, there were some important differentiators. The research agenda for 
cybernetics was focussed on machines, while GST was much broader. The com- 
mitment of cybernetics to behaviourist mechanical explanations outlined in the 
previous paragraph stands in contrast to the position within GST that mechanics 
provides an incomplete account of open systems. Thus in Boulding's hierarchy, 
systems at or above level four require more than just an understanding of infor- 
mation and control as provided by cybernetics at level three. Also, in cybernetics 
emergence was typically dismissed as incompleteness of the observer's knowledge 
of the parts and their couplings (see for example [HI pp. 110-112]). The only time 
cybernetics acknowledged genuine emergence was as a result of self-reference or 
circularity. Unlike GST, cybernetics embraced mechanistic explanations, but 
sought to augment the physicists' view of causes preceding effects with circular 
causation and goal-directed behaviour. 



1.3.3 Systems analysis 

Systems analysis was an extension of Operations Research (OR) to broader 
concerns. Morse and Kimball's [85j book set the standard for OR, including its 
definition. 

Operations research is a scientific method of providing executive de- 
partments with a quantitative basis for decisions regarding the op- 
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erations under their control. 

Although slightly older, OR had some common ground with the new systems 
approaches. In particular, OR too saw itself as an interdisciplinary approach 
based on scientific methods. The way in which OR provided a scientific basis for 
decisions was to use mathematical models. Also, OR often developed integrated 
solutions, rather than considering individual components in isolation. Network 
flow, queueing theory and transportation problems are typical examples of this, 
but also serve to highlight some key differences. Traditional OR addressed prob- 
lems where the objectives were precisely given, and the components were fixed 
[44] . but their configuration could change according to the value of the control 
parameter x. The operations researcher would structure the problem by fram- 
ing it in such a way that the performance of alternative configurations could 
be compared against the same objective. This focus on increasing measurable 
efficiency meant that OR was traditionally interested in only one organisation: 
the configuration that gives the global minimiser of the objective function /(x). 
As OR developed increasingly sophisticated mathematical techniques, it became 
more theoretical and less interdisciplinary, which led to a number of issues that 
have already been mentioned in Section [1.21 

In the newly established RAND (Research ANd Development) Corporation, 
the mathematician Paxson (whose work has not been declassified) was more in- 
terested in decisions affecting the next generation of military equipment, than 
configuring a fixed set of platforms already in operational service. Early appli- 
cations of OR to what Paxson called "systems analysis" were criticised because 
they did not adequately consider costs [37j . Consequently, systems analysis be- 
came a collaborative venture between mathematicians/engineers and economists. 
Successful high profile projects in air defence and the basing of bombers added 
"Red Team" game-theoretical approaches to the systems analysis methodology, 
generated sustained interest in systems analysis within RAND, and gained the 
attention of senior management. As well as borrowing from and extending OR, 
systems analysis inherited the black boxes and feedback loops from cybernetics 
in order to construct block diagrams and flow graphs. A subsequent technique 
for performing systems analysis - Forrester's [33j system dynamic^ - made more 
explicit use of these cybernetic concepts. After a decade where RAND led the 
formalisation and application of the systems analysis methodology, in 1961 the 
Kennedy Administration brought both RAND people and systems analysis tech- 
niques into government to provide a quantitative basis for broad decision- making 
problems [37] . McNamara's use of systems analysis within the Department of 
Defense and NATO was highly controversial and widely criticised. Nevertheless, 
it is notable as the systems approach which has had the greatest impact on so- 
ciety, due to the scale and nature of the decisions that it justified. In particular, 
the Vietnam war was planned with considerable input from systems analysis 
techniques combining operations research with cost analysis. 



^System dynamics represented the world as a system of stocks and flows, from which the 
behaviour of feedback loops could be deduced. 
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Aside from a rudimentary use of feedback, systems analysis was largely in- 
dependent of developments in systems theory. As Checkland [ST, p. 95] nicely 
described it, 

on the whole the RAND/OR/management science world has been 
unaffected by the theoretical development of systems thinking, it 
has been systematic rather than systemic in outlook . . . 

By this, Checkland meant that systems analysts assembled cookbooks of me- 
chanical solutions to classes of recurring problems, rather than developing tech- 
niques that addressed emergent properties, interdependencies and environmental 
influences. In so far as it was applied to the class of simple mechanical systems 
depicted above in Figure [TTTl this was perfectly reasonable. However, as the in- 
terests of systems analysis broadened from merely technical systems to include 
many social factors, this omission became more apparent. 

1.3.4 Systems engineering 

Systems engineering has a history quite separate to the systems movement. Its 
closest historical link comes from the application of systems analysis techniques 
to parts of the systems engineering process. The need for systems engineer- 
ing arose from problems in the design and implementation of solutions to large 
scale engineering challenges spanning multiple engineering disciplines. A mul- 
tidisciplinary team of engineers required a lead engineer whose focus was not 
the design of individual components, but how they integrated. Consequently, 
management concerns were as significant as technical challenges for a systems 
engineer. The Bell Telephone Laboratories and Western Electric Company's 
design and manufacture of the Nike air defence system, commenced in 1945, is 
widely cited as one of the first systems engineering projects. The surface to air 
missile defense program integrated ground-based tracking radars, computers and 
radio controlled anti-aircraft rockets, in order to protect large areas from high al- 
titude bombers. It was novel because unlike conventional anti-aircraft artillery, 
Nike allowed continuous missile guidance: the radars and computers enabled 
feedback and control. Bell Labs were the prime contractor for the project, while 
much of the detailed engineering was undertaken by the major subcontractor, 
Douglas Aircraft Company. The 1945 Bell Labs report A Study of an Antiair- 
craft Guided Missile System was considered a classic in applied interdisciplinary 
research due to its depth of insight, scope, and influential role in the systems 
engineering of Nike [41] . 

Following the success of individual systems engineering projects. Bell Labs 
structured itself around the new systems engineering approach. Bell Labs was or- 
ganised into three areas: basic research, systems engineering and manufacturing 
projects |64j . The systems engineering area provided the interface between ad- 
vances in communications theories and the manufacture of commercial systems. 
Because of the "whole system" perspective within the systems engineering area, 
it was responsible for prioritising the activation of projects with the greatest 
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potential user benefit, within the technical feasibility of communications the- 
ory. The responsibility of the systems engineer was the choice of the "technical 
path" between theory and application in order to create new services; improve 
the quality of existing services; or lower their cost. Because of its emphasis on 
user benefit, standards were seen to play a vital role in systems engineering. 
Standards were used to measure quality of service, which enabled cost benefit 
analysis of different technical paths. 

When framed as the decision-making problem of selecting between different 
technical paths on the basis of cost effectiveness, systems engineering appears 
closely related to the problems that RAND were concurrently tackling with sys- 
tems analysis. Bell Labs was aware of this analogy [1091, and drew on OR and 
systems analysis techniques. However, the systems engineer typically placed a 
greater emphasis on technical knowledge than the systems analyst, and corre- 
spondingly less emphasis on mathematical models. In contrast to the dynamical 
models of systems analysis, systems engineers developed architectures to repre- 
sent system designs. 

Outside Bell Labs, Project Apollo was one of the highest profile early suc- 
cesses of the systems engineering approach, which quickly spread from its origins 
in defence to also become the standard approach to large scale civilian projects. 
The traditional systems engineering process can be summarised as follows: 1) 
Customer needs are captured in precise, quantified requirements specifications; 
2) System requirements are decomposed into requirements for subsystems, until 
each subsystem requirements is sufficiently simple; 3) Design synthesis inte- 
grates subsystems; and 4) Test and evaluation identifies unintended interactions 
between subsystems, which may generate additional requirements for some sub- 
systems. If there are unintended consequences (i.e. unplanned emergent prop- 
erties), the process returns to stage 2, and repeats until the system meets the 
requirements. 

Because systems engineering is applied to the most ambitious engineering 
projects, it also has a long list of large and public failures [12]. Partly in 
response to perceived failures, systems engineering has identified "System of 
Systems" problems as a distinct class of problems that are not well suited to 
traditional centrally managed systems engineering processes. Although there is 
not a standard System of Systems (SoS) definition, the term SoS usually de- 
notes heterogeneous networks of systems including a majority of Maier's [75] 
discriminating factors: operational and managerial independence, geographical 
distribution, and emergent and evolutionary behaviours. The recent popular- 
ity of the SoS buzzword in the systems engineering literature has prompted the 
expansion of systems engineering techniques to include methods that can cope 
with evolving networks of semi-autonomous systems. This has led many systems 
engineers to read more widely across the systems literature, and is providing a 
re-conceptualisation of systems engineering as part of the systems movement, 
despite its historical independence. This is reflected in the latest INCOSE hand- 
book [521 P- 2.1], which states "[t]he systems engineering perspective is based 
on systems thinking" , which "recognizes circular causation, where a variable is 



What is a Systems Approach? 



19 



both the cause and the effect of another and recognizes the primacy of interre- 
lationships and non-hnear and organic thinking — a way of thinking where the 
primacy of the whole is acknowledged" . 

1.3.5 Soft systems 

The systems approaches I have surveyed so far have each expressed an un- 
bounded enthusiasm for multi-disciplinarity in their missionary papers, and yet 
all have tended to converge towards a relatively narrow band of 'hard' scientific 
methods, where this is taken to mean strong scepticism towards any theory that 
cannot be stated exactly in the language of mathematics. C. P. Snow's famous 
"Culture Gap" between literary intellectuals and scientists proclaimed that a 
gulf between the two cultures prohibited any real communication or shared un- 
derstanding between them. A related, but perhaps deeper cultural divide was 
noted a generation earlier by James 58] (as quoted in [76]) in 1909: 

If you know whether a man is a decided monist or a decided pluralist, 
you perhaps know more about the rest of his opinions than if you 
give him any other name ending in 'ist' ... to believe in the one or 
in the many, that is the classification with the maximum number of 
consequences. 

Even within science, this metaphysical divide can be observed. Another way 
of approaching the dichotomy is to ask whether the goal of enquiry is objective 
knowledge or inter-subjective discourse. Hard science, by accepting only math- 
ematically precise arguments, adopts a monistic stance. Consequently, hard 
science is associated with the search for a unified rational foundation for sys- 
tems universally valid across the sciences. Von Bertalanffy, Wiener, Ashby and 
Forrester all clearly held this aspiration to varying degrees. In contrast, a plu- 
ralist position rejects the possibility of unification, emphasising the incommen- 
surability of frameworks that view reality from different perspectives. This is 
rejected by the monist, because it is seen to be opening the door to inconsis- 
tency, paradox, relativism and irrationality. Within the Macy conferences, issues 
of subjective experience and Gestalten (form perception) were raised, usually by 
psychoanalysts such as Kubie [5]. The hard scientists sustained vocal criticism 
that tended to suppress these ideas: in particular, they strongly questioned the 
scientific status of psychoanalysis. 

Von Foerster, an editor of the Macy conference proceedings, later developed 
second order cybernetics |105] . which shifted attention from the cybernetics of 
observed systems, to the cybernetics of observing systems. In studying the 
"cybernetics of cybernetics" , von Foerster applied cybernetic concepts to the 
observer, which led him to reject the possibility of objective observation. Von 
Foerster's [106j variant on James' metaphysical distinction was introduced as 

a choice between a pair of in principle undecidable questions which 
are, "Am I apart from the universe?" Meaning whenever I look, 
I'm looking as if through a peephole upon an unfolding universe; or, 
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"Am I part of the universe?" Meaning whenever I act, I'm changing 
myself and the universe as weU. 

By adopting the latter position, von Foerster was dismissing the search for a 
unified rational foundation for systems as an ill-posed problem. Even though 
von Foerster approached second order cybernetics using essentially hard tech- 
niques, he played an important role in undermining the doctrine of objectivity 
that "[t]he properties of the observer shall not enter the description of his ob- 
servations" |105j . Second order cybernetics provides a scientific basis for the 
theory-ladenness of observation: the philosophical assertion that all observa- 
tions contain an inseparable element of theory. 

In 1981, Checkland ITT published the first sophisticated systems methodol- 
ogy for 'soft' problems. Checkland firstly divided systems into five types: natural 
systems (atomic nuclei to galaxies); designed physical systems (hammers to space 
rockets); designed abstract systems (mathematics, poetry and philosophy); hu- 
man activity systems (a man wielding a hammer to the international political 
system); and transcendental systems (as in Boulding's hierarchy, although these 
are not considered in detail). Checkland's central thesis was that human activity 
systems were fundamentally different in kind from natural systems, and conse- 
quently required a fundamentally different approach. Checkland [211 p. 115] 
argued that 

The difference lies in the fact that such systems could be very dif- 
ferent from how they are, whereas natural systems, without human 
intervention, could not. And the origin of this difference is the spe- 
cial characteristics which distinguish the human being from other 
natural systems. 

That special characteristic is self-consciousness, which is claimed by Checkland 
to provide "irreducible freedom of action" to humans. However, one should 
note that this distinction between the human being and other natural systems 
is much more of a metaphysical assertion than an empirical fact, and it is the 
most crucial theoretical assertion for Checkland's argument against the use of 
hard methods in human activity systems. 

The fundamentally different approach that Checkland used to investigate 
human activity systems was 'action research'. According to Checkland [311 p. 
152], 

Its core is the idea that the researcher does not remain an observer 
outside the subject of investigation but becomes a participant in the 
relevant human group. 

From this, it is clear that action research follows von Foerster's lead in exploring 
the implications of acting as part of the universe. This commitment is respon- 
sible for the two distinguishing features of the soft systems approach: the way 
problems are framed, and the way models of the system are built and used. 

The difference in problem framing is most clearly visible in Checkland's [311 
p. 316] definition of a soft problem: 
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Definition 1.3 (Problem, Soft) A problem, usually a real-world problem, 
which cannot be formulated as a search for an efhcient means of achieving a 
defined end; a problem in which ends, goals, purposes are themselves problem- 
atic. 

Thus, instead of defining an objective that can be tested at any point in time to 
see if it has been met, the soft systems approach operates with a comparatively 
unstructured and fuzzy understanding of the "problem situation" . Because the 
problem is framed using only minimal structure, the quantitative methods of 
OR and systems analysis cannot be brought to bear on its solution. Nor is the 
aim of soft systems optimal efficiency, instead it seeks feasible, desirable change. 

The way models are built is fundamentally pluralist: "human activity sys- 
tems can never be described (or 'modelled') in a single account which will be 
either generally acceptable or sufficient" |31j p. 191]. It is accepted that differ- 
ent people will view the system and its problems differently, and models aim to 
make explicit the assumptions of a particular view in order to facilitate dialog, 
rather than building a single foundational representation of the system. Thus, 
the difference between hard and soft systems approaches is a deep divide: it is 
James' metaphysical distinction between the belief in the one or in the many. 
Perhaps the most important point in favour of soft systems methodology is that 
it has mostly been considered useful in practice for solving real-world problems 

m- 

Habermas [49] added a further category in contrast to what I have described 
as hard and soft approaches, with the development of critical theory. Accord- 
ing to Habermas, humans have developed a technical interest in the control 
and manipulation of the world; a practical interest in communicating to share 
understanding with other people; and an emancipatory interest in self develop- 
ment and freedom from false ideas. Critical theory aims to reveal systematic 
distortions resulting from the power structure that affect both hard (technical) 
and soft (communicative) approaches. It formed the theoretical basis for critical 
systems theory, which has produced several methodologies [56l [99] for taking 
practical action in management contexts. However, because the intention of 
critical theory is emancipation, not design or even intervention, these methods 
have struggled to resolve this fundamental inconsistency. The main contribution 
of critical systems theory to date has been to critique both the hard and soft 
systems approaches, rather than to advance a practical alternative to systems 
design (see for example [80]). Consequently, it will not be considered further in 
this thesis. 

1.3.6 Complex systems 

Complex systems became known as a distinct systems discourse with the es- 
tablishment of the Santa Fe Institute (SFI). A widely read romantic account 
of the formation of the SFI and its initial research agenda was published by 
the science writer Waldrop [108] . Its success set the model for communicating 
complex systems research to the informed general public through easy to read 
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popular science novels. These novels attempted to capture the excitement of 
research on the frontier of "a new kind of science" , while at the same time em- 
phasising its applicability to important global issues, which are inevitably both 
systemic and complex. The upside of the way complex systems was marketed 
is that it has grown to become the most activj^ area of systems research; the 
barrier to entry from many disciplinary backgrounds is comparatively low, since 
discipline-specific jargon is minimised; and there is a largely positive perception 
of complex systems in the wider community, where there is awareness at all. 
The downside to this approach includes a proliferation of poorly defined buz- 
zwords; a level of hype that is reminiscent of early AI; and widespread use of 
complex systems as a superficial metaphor. Of course this is not the only legacy 
of the SFI: it has established a dynamic network of talented systems researchers 
affiliated with many Universities, which interacts with a network of powerful 
corporations (both networks are almost entirely confined to the USA), within a 
unique and effective business model. It has also published a high quality series 
of proceedings from invite-only workshops on a diverse array of interdisciplinary 
topics that have added considerable substance to the complex systems approach. 

The New England Complex Systems Institute (NECSI) has taken a much 
more systematic approach to complex systems. Bar- Yam's jTTj complex systems 
textbook collated a large survey of the mathematical techniques in complex sys- 
tems, including iterative maps, statistical mechanics, cellular automata, com- 
puter simulation, information theory, theory of computation, fractals, scaling 
and renormalisation. These techniques were then further developed and applied 
to the brain, protein folding, evolution, development, and human civilisation, to 
demonstrate the interdisciplinary breadth of complex systems applications. In 
addition to publishing the only comprehensive textbook on complex svstemj^. 
NECSI hosts the International Conference on Complex Systems, which is the 
premier complex systems conference. 

Taking these two organisations as representative of the complex systems ap- 
proach, complex systems is essentially a refinement of the GST/cybernetics re- 
search agenda. There has, in fact, been remarkably little interaction between 
complex systems and second order cybernetics, soft systems or critical systems: 
the insights from these alternative systems approaches are neither acknowledged 
nor addressed. (GST is usually just not acknowledged - the term never appears 
in [m gg m [9S1 im HO].) Nor do the contemporary soft approaches draw 
on the techniques of complex systems. This could be explained by a general aver- 
sion to mathematics - for example, Midgley's four volumes of systems thinking 
explicitly aimed to exclude "papers that were heavily dependent on a high level 
of mathematical reasoning" |791 p. xxi]. Consequently, of 76 papers on systems 
thinking, only one high-level paper on complex systems was included. There has 
been greater interaction between complex systems and other 'hard' systems ap- 



^'^This claim is justified by the scale and number of conferences, tlie number of complex 
systems centres, and the volume of new research, in comparison to other systems approaches. 

Other more specialised books do now exist, such as Boccara's |19l textbook on the physics 
of complex systems. 
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proaches: OR and systems analysis share techniques such as genetic algorithms 
[47j and particle swarm optimisation |65| with complex systems, while the new 
area of complex systems engineering |22j augments systems engineering problems 
with complex systems approaches. To show just how closely the aims of com- 
plex systems overlap with the GST/cybernetics research agenda, analogs of the 
ideas introduced in Sections 11.3.11 and 11.3.21 are now identified within complex 
systems. 

Whereas von Bertalanffy imagined unity of the sciences through isomor- 
phisms, Gell-Mann [45, p. Ill] talks of building staircases (or bridges) be- 
tween the levels of science, while Bar- Yam [TTl p. 2] cites universal properties 
of complex systems, independent of composition. Self-organisation, which has 
been labelled antichaos [61] due to its stabilising dynamics, is a substitute for 
equifinality. However, equal attention is now given to chaotic dynamics - which 
exhibit sensitivity to initial conditions - to demonstrate the limits of the classical 
state-determined system. Goal-directed behaviour is studied under the heading 
of autonomous agents [63l p. 49]. Organisation is still of central importance [63l 
p. 81] - especially self-organisation [MIES], [HI P- 691] - which largely follows 
in the tradition of either Prigogine [87j (viewed as an open system far from equi- 
librium) or Ashby [9] (viewed as an increase in organisation or an improvement 
in organisation). 

The preoccupation in complex systems with quantifying the complexity of a 
system is a minor extension of the desire to understand organisation in general, 
and qualitatively expressed in Weaver's concept of organised complexity. The 
most common way to quantify complexity is by the amount of information it 
takes to describe a system, which follows from the use of Shannon information 
theory in cybernetics, but also borrows from theoretical computer science the 
notion of algorithmic complexity. Ashby's conceptualisation of adaptation and 
learning as an adaptive walk in the parameter space of a dynamical system 
is followed by Kaufi^man [6ll P- 209], and generalised theories of adaptation 
and evolution have been developed by Holland [S3] and Bar- Yam [TT, p. 531] 
respectively. Meanwhile, genetic algorithms [47], artificial neural networks [55] . 
reinforcement learning [97] and ant colony optimisation [38] are a selection of 
biologically inspired practical techniques used to generate adaptation in complex 
systems. 

Von Neumann's [107] theory of natural and artificial automata are still stud- 
ied in a mostly pure mathematical branch of complex systems - cellular automata 
- that can be expected to gain increasing attention from potential applications in 
areas such as Field Programmable Gate Array (FPGA) design and nanotechnol- 
ogy. Emergence continues to be a central concern in complex systems [54l [34l fT3] . 
Boulding's hierarchy among the disciplines of science is maintained by Gell-Mann 
[IS] pp. 107-120], although Simon's view of systems as nested hierarchies has 
been mostly supplanted by the consideration of systems as networks [THJ llllj . 
An approximate translation between GST/cybernetics and complex systems is 
summarised in Table [L2l 
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Table 1.2: Comparison of the themes of general systems theory and cybernetics 
with complex systems. 



General Systems Theory 
and Cybernetics 


Complex Systems 


Unity of science through 
isomorphisms 


Coherence of science through 
bridges 


Isomorphic mappings 


Universality classes 


Emergence 


Emergence 


Organisation 


Self-organisation 


Organised complexity 


Complexity 


Adaptation 


Adaptation/evolution 


Equifinality 


Chaos and antichaos 


Goal-directed behaviour 


Autonomous agents 


Automata 


Cellular automata 


Hierarchies 


Networks 



With so much commonality, what is different about the field of complex 
systems? In terms of the research agenda, very little. 

Phelan [88] notes the broad similarities between complexity theory (referred 
to here as complex systems) and systems theory (by which Phelan means sys- 
tems methodologies in operations research, engineering and management sci- 
ence, following from the pioneering systems work of von Bertalanffy, Ashby 
and Boulding), but attempts to also distinguish between the two. According 
to Phelan, systems theory is predominantly focused on intervention, whereas 
complex systems is more interested in exploration and explanation. Whereas 
the system dynamics models of systems theorists only capture the aggregate 
flow of quantitative parameters, complex systems models consist of unique in- 
dividual agents capable of learning, planning and symbolic reasoning, capturing 
the micro-diversity that systems theory did not. Thirdly, Phelan claims that 
'complexity' has a different interpretation within the two fields. For systems 
theorists, "complexity is a function of the number of system components and 
the amount of interaction between them". In contrast, in complex systems com- 
plexity "is something of an illusion — it is something that emerges when several 
agents follow simple rules" . 

Of these three distinctions, the second is the the most meaningful. The first 
distinction is a matter of emphasis: both systems theory and complex systems 
are in the business of both explanation and intervention (consider the interven- 
tions recommended by the companies that comprise the Santa Fe Info Mesa). 
The third distinction may be true for the work of some complex systems theorists 
- such as Holland [531154] and Wolfram [117j - but does not hold for others, such 
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as Bar- Yam [TT] and KaufFman [55] ■ It is more accurate to observe that there 
are many more ways to think of complexity (algorithmic complexity, behavioural 
complexity, effective complexity, multiscale complexity, physical complexity and 
structural complexity, to name a few) in complex systems than the approach 
initially taken by systems theorists. 

The principle difference between complex systems and GST/cybernetics is 
not the questions that are being asked, but the way in which they are answered. 
The techniques of complex systems have made substantial ground on the ques- 
tions that the early systems theorists asked, but did not have the methods to 
answer. Agent based models, as identified by Phelan, are one component of this 
expanded toolkit within complex systems. It is only when one delves beyond the 
level of metaphor that complex systems reveals its contributions to the systems 
approach. 

The analytical techniques within complex systems to understand organisation 
can be separated by three broad aims: to analyse the patterns, the scales and 
the dynamics of a system. Patterns that are discoverecP^ in measurements or 
descriptions of a system indicate the formation of structure in either space or 
time. Kauffman's boolean network models of self-organisation [62], network 
theory, [TS] llllj and computational dynamics [33] are examples of the analysis 
of pattern formation, where couplings, interactions and correlations respectively 
between parts of a system give rise to measurable regularities. 

The relationship between an observer and a system can be analysed in terms 
of the scale and scope over which the observer interacts with the system. Mul- 
tiscale analysis techniques [TT] jM] p. 258] provide a method for relating the 
possible system configurations that are observed at different scales. The de- 
velopment of the renormalisation groujlll ^I16j . and dynamic renormalisation 
theory to analyse critical phenomena in physics provides an important general 
method of identifying the important parameters when the equations describing 
the system are independent of scale. In such cases, the method of separation 
of scales does not apply. Renormalisation operates by abstracting interdepen- 
dencies between fine scale variables into interdependencies between coarse scale 
variables, and can be applied recursively. Fractals provide another significant 
set of techniques that enable multiscale analysis in complex systems, which were 
not available to GST. 

Dynamics relates the behaviour of the system to its behaviour in the past. 
Dynamics can place constraints on future configurations, identify attractors and 
other patterns that occur in time. The calculus of nonlinear dynamical systems 
was not invented until after the peak of GST activity, meaning the early sys- 
tems theorists talked of steady states and equilibria, rather than attractors and 
bifurcations. The dynamics of evolution and more generally adaptation (which 
includes learning as well as evolution) are of particular interest, as the only 

^^Whether the patterns are a property of the system, the observer, or the relationship 
between them is a non-trivial question that is intimately related to the theory-ladenness of 
observation. See Dennett |35) for an insightful discussion on patterns. 

^^Note that there is a connection between the renormalisation group and Simon's nearly 
decomposable systems |96) . 
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processes that are known to generate multiscale complexity (ie. increase organ- 
isation over multiple scales). Advances in biology since GST include a much 
better understanding of group selection pressures in evolution; swarm intelli- 
gence in social insect populations; and the operation of the adaptive immune 
system; all of which complex systems has drawn on and contributed to. 

As well as analytical advances, the impact of the Information Technology rev- 
olution on complex systems can hardly be understated. Von Neumann's original 
automata were computed with pencil and paper. In contrast, Barrett's TRAN- 
SIM Agent Based Model (ABM) (see for example [30]), running on Los Alamos 
National Laboratory supercomputers, has simulated the individual decisions of 
an entire city's motorists. Currently, there are ABM platforms capable of simu- 
lating over a million non-trivial agents, such as MASON |71]. At its best, agent 
based modelling can combine all three threads of the complex systems approach 
to understanding organisation, simulating adaptive pattern formation over mul- 
tiple scales. While the computational power and relative simplicity of ABMs can 
be abused, acting as a substitute for thought^, it has provided complex systems 
with a unique approach to model-building that stands in contrast to aggregate 
models, such as those used in system dynamics. 

An example of an aggregate model that has been widely used in defence is the 
Lanchester differential equation for combat attrition, which relates the mass and 
effective firing rate of one side to the rate of attrition of the opponent. Rather 
than directly guess the functional form of aggregate attrition rates, the agent 
based approach models the individual agents, and the aggregate behaviour is 
computed from the 'bottom up'. If the individual behaviour is easier to model 
than the aggregate behaviour, ABMs can eliminate the need to make simplify- 
ing assumptions about the macroscopic dynamics, instead allowing macroscopic 
patterns to 'emerge' from the microscopic rules and interactions ^U\. ABMs are 
also useful when the spatial configuration is relevanlF^ (c.f. Angyal above); when 
autonomy is distributed across many agents; when thresholds, nonlinearities or 
logical conditions govern individual decision-making; and when the rules change 
or the agents learn. 

Of course, complex systems is not the only field to simulate the behaviour 
of individual agents in order to predict aggregate behaviour. In contrast to 
physics-based constructive simulations, the agents in ABMs are relatively ab- 
stract. However, the relationships are typically richer, which gives rise to collec- 
tive properties in addition to the properties of the simple agents. 



^"^The complex systems community but also the wider scientific community has been par- 
ticularly vocal in its criticism of Wolfram's |117| book on this account - see for example 
|9l1[671[68l[59ll46l . 

'^^If the spatial dimension is abstracted away but the interactions are retained, an ABM 
essentially becomes a network model, which has a set of analytical techniques that are increas- 
ingly popular within complex systems. 
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1.4 Defining 'System' 

A System is a set of variables sufBciently isolated to stay discussable 
while we discuss it. 

W. Ross Ashby 

The historical approach to understanding systems provided a rich context 
within which individual contributions to systems theory could be assessed. In 
this section, my aim is to distill this into a concise definition, which captures 
the essence of the systems approach. Every definition must choose a position 
along a tradeoff between generality and depth of insight: as Boulding [21] notes, 
"we always pay for generality by sacrificing content, and all we can say about 
practically everything is almost nothing." In contrast to Definition II. ![ my 
definition of 'system' will not be a catch-all container. As a relatively strong 
definition of system, it will exclude some entities that are legitimately systems 
in the informal sense - such as closed systems - but which are not the focal 
subject of the systems approach. Recalling that the focal subject is "organised 
complexity" , this excludes entities with trivial structure or trivial behaviour, 
such as a contained gas, or well mixed solution of chemicals at equilibrium. The 
important points to consider from the previous section are: 

1. Systems are an idealisation; 

2. Systems have multiple components; 

3. The components are interdependent; 

4. Systems are organised; 

5. Systems have emergent properties; 

6. Systems have a boundary; 

7. Systems are enduring; 

8. Systems effect and are affected by their environment; 

9. Systems exhibit feedback; and 

10. Systems have non-trivial behaviour. 

Burke [28] defines a system as "an idealisation of an entity as a complex whole." 
This is an extremely compact definition that incorporates the first seven aspects 
of systems listed above. Importantly, it explicitly recognises that as an ideali- 
sation, a system abstracts away many details of an entity (the map is not the 
territory). A system is not a physical object, it is a representation that stands 
in for an entity, and it is always constructed and used by an agent (or observer). 
The use of the word entity indicates that the subject of the idealisation may 
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equally be abstract or substantial. The word complex implies multiple com- 
ponents, organised in a non-aggregative arrangement. Also, complexity implies 
interdependence p. 12]. The system boundary, its enduring nature, and 
emergent properties in addition to the aggregate properties of the parts are all 
implied by the term whole in Burke's definition. 

However, the final three aspects of systems are not directly implied by this 
definition. Eight requires a system to be open. There is a subtle point here that 
requires explication, due to the fact that the system boundaries are chosen by 
the observer. Any open system can always be reframed as closed by expanding 
the system boundaries to include its environment. When applied recursively 
this method achieves closure with certainty, since the Universe is closed to the 
exchange of energy, matter and information. However, if for every possible sys- 
tem/environment partitioning the system is closed, then its long term behaviour 
will be trivial. Consequently, a more accurate way to state this requirement is 
that there exists at least one system/environment partition such that the system 
is open. 

Together, eight and nine imply ten, since an open system requires more infor- 
mation than the initial conditions of the system to predict its future behaviour, 
and combinations of positive and negative feedback between the system and its 
environment are the source of non-trivial behaviour. This implication was made 
precise by von Foerster |104j . who distinguished between trivial and non- trivial 
machines. The former have invariant input-output mappings and determinate 
behaviour, whereas the latter have input-output relationships that are deter- 
mined by the machine's previous output. Non-trivial machines may be deter- 
ministic, yet are still unpredictable. According to this distinction, feedback is 
necessary and sufficient for non-trivial machines. I now present my definition of 
system for this thesis, which incorporates all ten aspects of a systems approach: 

Definition 1.4 (System (7)) A system is a representation of an entity as a 
complex whole open to feedback from its environment. 

I define a system as a representation rather than an idealisation, because 
even though the meaning is similar, representation has a well defined theoretical 
basis. This definition is too restrictive as a commonsense conception of system, 
but it provides insight on both the nature of systemic problems and the value of 
the systems approach. Because a system is a representation, it can stand in for 
the entity it represents. Systems are useful idealisations that complement the 
traditional abstractions within scientific disciplines, such as the point masses, 
frictionless surfaces, and massless springs of physics. All representations are 
based on simplifying assumptions, and as a consequence there are limits to their 
application. 

This connection can help to clarify when the systems approach should apply. 
By rephrasing the list of systems aspects above, one can derive a set of simplify- 
ing assumptions of non-systemic approaches which deserve careful examination. 
This line of reasoning follows closely from Churchman's question, and has been 
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explored elsewhere. For example, Bar- Yam [TTJ pp. 91-95] takes this approach 
to contrast complex systems with the assumptions of thermodynamics. Wein- 
berg [113j also provides an extensive discussion of the simplifying assumptions 
of science, and the importance in systems science of understanding the limits 
of applicability of simple models. When one or more assumptions are violated, 
then the systems approach may provide useful insights and more appropriate 
models (but never complete understanding). The assumptions of non-systemic 
approaches include: 

1. The system is closed; 

2. Averaging over time and across individuals is valid; 

3. Superpositionality holds; 

4. Space can be ignored; 

5. Local structure is smooth; 

6. Different levels are independent; 

7. Control is centralised; and 

8. Causation is linear. 

The assumption of a closed system enables the design of reproducible ex- 
periments with predictable outcomes from the same initial conditions, and the 
powerful inevitability of increasing entropy obtains, meaning dynamics are irrel- 
evant to long-term behaviour and equilibrium states dominate. However, under 
this assumption only a limited number of properties of open systems far from 
equilibrium can be explained. Classical statistics affords great simplification for 
modelling systems with minimally biased estimators that average over time series 
and across individual members of an ensemble. However, averaging over time 
destroys information about temporal structure, while averaging over individuals 
hides the unique properties of the individual. 

Superpositionality means that the whole is the sum of the parts: interactions 
within the system can be evaluated by calculating the sum of the pairwise inter- 
actions between components. This greatly simplifies the modelling process, and 
is consistent with Occam's Razor, because it assumes the minimal additional 
information about the system of interest. However, it assumes commutativity 
and that only first-order dyadic interactions exist. Therefore, superpositionality 
only strictly applies to aggregates, not systems where the structure of interac- 
tions affects the system's properties, and where the forces on a component have 
indirect effects. Similarly, assuming that spatial arrangement can be ignored 
simplifies the analysis of well-mixed systems, but if there is significant spatial 
structure, the assumption of global mixing may give misleading results, as lo- 
cal interactions depart from the average behaviour given by uniformly mixed 
interactions. 
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When a system's behaviour is fairly trivial, then one can safely assume that 
at finer scales, the local structure becomes smooth [111 p. 258], and that different 
levels can be analysed in isolation. The former assumption allows the applica- 
tion of calculus, while the latter allows the technique of separation of scales, 
which averages over fast processes and fixes the slow processes to analyse the 
intermediate dynamics [TI] p. 94]. These assumptions do not hold universally. If 
infinitesimals diverge or correlations occur over all scales - both of which occur 
at a second order phase transition - new modelling techniques are required. 

Assuming control is centralised improves modelling efficiency: most compo- 
nents can be ignored because they are inert in the control process, and control 
becomes sequential, synchronous and linear. However, if autonomy is distributed 
across many system components, its behaviour may be qualitatively different to 
the centralised model. Typically, a system with distributed control may be ex- 
pected to be less efficient but more robust and adaptive. Finally, the assumption 
that causation is always best modelled by a linear chain between effects and prior 
causes, as viewed by Laplace's demon, may not always hold. An example von 
Foerster |106j gave in an interview with Yveline Rey is how the process of a per- 
son switching on a light can be much more efficiently described as how causes in 
the future, "to have the room lit" , determine actions in the present, "turn the 
switch now" . It also explains why if turning the switch on does not illuminate 
the room because the globe is blown, subsequent actions find an alternative path 
to the same end, such as "draw the curtains" . 

This list of assumptions is not complete, but a large proportion of systems 
research can be motivated in terms of developing alternative techniques for when 
these assumptions do not hold. Alternatively, systems theory may generalise al- 
ternative techniques when they arise within more specialised disciplines, seeking 
to organise available techniques not by discipline, but by their assumptions about 
the system's structure and dynamics. Thus, a good deal of attention is paid to 
surfacing modelling assumptions and discussing limits of applicability within any 
systems approach. However, where GST found it difficult to say much about 
systems in general, contemporary systems approaches have had more success in 
identifying significant features of classes of systems that share certain properties 
(e.g. chaotic systems), or specific mechanisms for their generation (e.g. genetic 
algorithms) [96j . The GST ambition to unify science has been supplanted by 
the narrower but more realistic task of forging interdisciplinary links between 
specific models within the disciplines. 

1.5 Conclusion 

The systems movement is an attempt to understand organisation, a concept that 
is trivialised in mechanism and remains un-analysed in holism. Organisation is a 
compound concept that incorporates both structure and dynamics. The result of 
over half a century of systems thinking is not a general theory of organisation, 
but a loosely connected set of techniques, where each technique contributes 
some insight on the temporal and spatial structures of organised complexity. 
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Because no single technique provides a complete understanding of organisation, 
knowledge of the limits of applicability of individual techniques is central to any 
systems approach. 

Complex systems is arguably the most active contemporary field of systems 
research. It follows in the spirit of general systems theory and cybernetics, 
although it is less concerned with rhetoric on the unity of science as the devel- 
opment of quantitative models that have interdisciplinary application. Systems 
analysis and systems engineering have longer and much richer experience with 
real world systems applications, but constitute a comparatively superficial com- 
mitment to systems theory. All of these approaches can be broadly characterised 
as hard approaches, concerned with the exact scientific application of mathemat- 
ical models. 

The deepest divide between contemporary systems approaches occurs be- 
tween hard and soft methods. Soft systems methodologies take a pluralist stance, 
where a systems model is taken to say more about the modeller and their assump- 
tions than the system of interest itself. Advocates of soft systems approaches 
claim that hard approaches to social systems can be dangerous, because they do 
not account for the special nature of self-conscious and free- willed humans. Due 
to the deep philosophical differences between hard and soft systems approaches, 
there exists little constructive dialog between these communities. 

A system is a representation of an entity as a complex whole open to feedback 
from its environment. The utility of a systems approach derives from the critical 
examination of simplifying assumptions. This helps to make explicit the asso- 
ciated limits of applicability, such that revision of the appropriate assumptions 
can extend the application of scientific model-building. The revisions apply in 
general to reductionist assumptions that wholes do not have properties apart 
from the properties of their components, and in particular to linear thinking 
about causation, composition and control. 
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